The length of time's arrow 
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An unresolved problem in physics is how the thermodynamic arrow of time arises from an un- 
derlying time reversible dynamics. We contribute to this issue by developing a measure of time 
symmetry breaking, and by using the work fluctuation relations, we determine the time asym- 
metry of recent single molecule RNA unfolding experiments. We define time asymmetry as the 
Jensen-Shannon divergence between trajectory probability distributions of an experiment and its 
time-reversed conjugate. Among other interesting properties, the length of time's arrow bounds the 
average dissipation and determines the difficulty of accurately estimating free energy differences in 
non-equilibrium experiments. 
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In our everyday lives we have the sense that time flows 
inexorably from the past into the future; water flows 
downhill; mountains erode; we are born, grow old and 
die; we anticipate the future but remember the past. 
Yet almost all of the fundamental theories of physics - 
classical mechanics, electrodynamics, quantum mechan- 
ics, general relativity and so on - are symmetric with 
respect to time reversal. The only fundamental theory 
that picks out a preferred direction of time is the second 
law of thermodynamics, which asserts that the entropy of 
the universe increases as time flows towards the future [ij . 
This provides an orientation, or arrow of time, and it is 
generally believed that all other time asymmetries, such 
as our sense that future and past are different, are a di- 
rect consequence of this thermodynamic arrow [3, Q • 

When the dissipation, or the total increase in entropy, 
is large, the orientation of time's arrow is self evident. If 
we watch a movie in which shards of pottery jump off the 
floor, assemble themselves into a cup, and land on a table, 
then clearly someone has threaded the film through the 
projector backwards. On the other hand, if the dissipa- 
tion is microscopic, then the distinction between past and 
future becomes nebulous. This is because a more general 
statement the second law claims the dissipation is pos- 
itive on average, (AS'totai) > [^, Q. If we repeat the 
same experiment many times, the entropy might increase 
or decrease on different occasions. Only the average dis- 
sipation must be positive. Thus, if we view a movie of a 
microscopic system undergoing a dissipative transforma- 
tion, we cannot determine with certainty whether time 
moves forward or backwards. 

Here, we seek a quantitative measure of time asym- 
metry in a driven microscopic system such as the single 
molecule RNA pulling experiments explained in Fig. [TJ 
Naively, one might use the average dissipation for this 
quantification, but we will show that a large average dis- 
sipation can arise for dynamics that are essentially time 
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FIG. 1: In this Letter, we discuss the definition and mea- 
surement of time-asymmetry in microscopic systems, (a) As 
a concrete example, we analyze the time asymmetry of a single 
molecule experiment in which an RNA molecule is attached 
between two beads i4t]. (a) One bead is captured in an optical 
laser trap that can measure the applied force on the bead. 
The other bead is fixed to a piezoelectric actuator. The con- 
trollable parameter A is the distance between the fixed bead 
and the center of the laser trap. For the forward protocol, the 
RNA hairpin is initially in thermal equilibrium in the folded 
state with extension A(a). The extension is then increased 
to X{b), unfolding the RNA. In the conjugate, time reversed 
protocol, the RNA is initially in thermal equilibrium in the 
unfolded state, and the extension is lowered from A(6) back to 
A(a), allowing the RNA to refold [l,[lli,0|- (b) Histograms of 
work measurements for folding and unfolding an RNA hairpin 
at three different rates. Observations are binned into integers 
centered at 1 ksT intervals. Note that Eq. (|6} predicts that 
the folding and unfolding work distributions cross at the free 
energy change. 



symmetric. Instead, we develop a measure based on the 
Jensen-Shannon divergence between the forward and re- 
verse probability distributions of trajectories for a micro- 
scopic system. We find that this measure of time's arrow 
has intuitive physical and information theoretic interpre- 
tations and constrains the minimum average dissipation. 
Moreover, recent advances in far-from-equilibrium sta- 
tistical physics allow one to measure time's arrow in real 
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world experiments. 

We consider a physical system driven from thermal 
equilibrium by an external perturbation. For such an 
experimental protocol, A denotes a set of controllable 
parameters X{t) for t S [a, b] which describe how the sys- 
tem is driven from the initial equilibrium at A(a). We 
are also interested in the conjugate time reversed proto- 
col A in which the system begins in thermal equilibrium 
at X{b) and the controllable parameters retrace the same 
series of changes, in reverse, back to A(a). In the single 
molecule experiments of Fig. [H the distance between the 
center of the laser trap and the fixed bead plays the role 
of X{t). For each realization of the forward protocol A, 
the system travels along a trajectory x which represents 
the states x{t) for t G [a,b]. We define a conjugate time 
reversed trajectory x such that x(<) — x(t) for t G [b, a]. 

We quantify the intrinsic time asymmetry of a driven 
system as the distinguishability of conjugate forward and 
reverse experiments. Given a microscopic trajectory x, 
can we tell if it was generated by the protocol A, or 
whether it is the time reversal of a trajectory generated 
by the reverse protocol A? Specifically, we define the 
time asymmetry A as 



^[A] = JS P[x|A] ; P[i|A] 



(1) 



in which P[x|A] and P[x|A] are the probabilities of tra- 
jectories during the forward and reverse protocol respec- 
tively, and JS is the Jensen-Shannon divergence between 
two probability distributions [H, El, Q [lE [Hi 
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Each of the two summands is the relative entropy (or 
KuUback-Leibler divergence) between one of the distri- 
butions and the mean of the two distributions. Hence, 
JS(p;q) > 0, and is equal to zero only if the two distri- 



butions are identical: pi = qi for all i 17[. The Jensen- 
Shannon divergence reaches its maximum value of In 2 
nats [i.e. 1 bit], if the two distributions do not overlap, 
Piqi = for all i, and therefore are perfectly distinguish- 
able. 

The Jensen-Shannon divergence has a direct interpre- 
tation in terms of a Bayesian inference problem 1J| . Sup- 
pose we are given a sample k taken from one of two prob- 
ability distributions, p or q. With no other way to dis- 
tinguish between the distributions, the prior probability 
for the distributions is P{s) = {|,|} in which s repre- 
sents either p ov q. The prior distribution of outcome k 
is therefore P{k) = ^pk + \qk while the posterior distri- 
bution is 



P{s\k) 
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(3) 



The information gained about s from observing state k 
is the relative entropy between the posterior and prior 



distribution. This information averaged over the prior 
distribution of outcomes is 



(A/) = ^ P(fc)A/ = ^ P(fc) ^ P(s|fc) In 



P(4fc) 
P[s) 



(4) 

Some elementary algebra reveals that this average in- 
formation gain is equal to the Jensen-Shannon diver- 
gence, (A/) = JS(p;(7). Hence, the time asymmetry 
A\K\ is the average gain in information about the ori- 
entation of time's arrow obtained from one realization of 
the experiment. Moreover, the square root of the Jensen- 
Shannon divergence is a metric between probability dis- 
tributions 



l4 [15| . Consequently, the square root of the 



time asymmetry y'A[A] measures the distance between 
the forward and reverse protocols in trajectory space, lit- 
erally the length of time's arrow. 

In addition to its information theoretic interpretation, 
the time asymmetry can be measured in experiments 
due to recent advances in far-from-equilibrium statisti- 
cal physics. In particular, the ratio of the probability 
of a trajectory during the forward protocol P[x|A] and 
the probability of its conjugate trajectory on the reverse 
protocol P[i|A] is [H] 



P[x|A] 
P[5|A] 



„/3W[x|A]-/3A_F[A] 



(5) 



in which (3 — l/k^T, T is the temperature of the en- 
vironment in natural units (fee is the Boltzmann con- 
stant), and VF[x|A] is the work performed on the sys- 
tem during the forward protocol A [l^, and 



(2) AP[A] = P; 



F\(a) is the difference in Helmholtz free 



energy between the initial and final ensembles. Eq. ([5]) 
is a direct consequence of the time reversal symmetry of 
the underlying dynamics and implies the work fluc- 
tuation theorem 



P{+W\A) 
Pi-W\A) 



(6) 



in which AP = AP[A]. Moreover, Eq. ^ gives that the 
time asymmetry is 



4A]-i(ln- 



exp(-/3M^[x|A] -H/?AP)/ A 
2 



+ i ( In ) , (7) 

2 \ 1 + exp(-/3I^[i|A] - /3AP) 

a non-linear average of the forward and reverse dissipa- 
tion. 

Time asymmetry is also closely related to the efficiency 
with which the free energy can be estimated from non- 
equilibrium measurements of the work. To determine AP 
from experimental realizations of the forward and reverse 
protocols, Bennett's method gives the log likelihood of 




1 2 3 4 5 6 7 h : Average dissipation (kT) 



FIG. 2: The squared length of times arrow A [Eq. ([T}] versus the hysteresis h [Eq. (llOf) ]. the dissipation averaged across 
a conjugate pair of forward and reversed experiments. The experiment is explained in Fig. [T] We equalize the number of 
data points between conjugate experiments, estimate the free energy from the data, obtain error bars by applying a Bayesian 
bootstrap and apply a correction for experimental errors, as described in [ij. The slower the experiment is performed, the 
closer to thermodynamic reversibility, the lower the dissipation, and the lower the time-asymmetry. The slowest experiments 
are known to contain the greatest experimental error [ij], which may explain the deviation of the slowest data from the linear 
response trend. 



the free energy difference as [11, S im, ii] 
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(8) 



Here, W[x,; | A] and W^[xj | A] are the work measured during 
the i and j realizations of the forward and reverse pro- 
tocols respectively. The maximum likcUhood estimate 
/S.F — argmax 1{/S.F) has the minimum variance among 



all estimators of AF [ll|, l2l|, ISl- Comparing Eqs. 
and ([8]), the time asymmetry can be estimated with the 



Bennett likehhood in the large sample limit, ^23i. i24i] 



A[A]«— ^(AF)+ln2 



(9) 



Thus, we can simultaneously estimate A_F and the time 
asymmetry by maximizing A[K\ with respect to AF. 

It is enlightening to contrast the length of time's arrow 
with the hysteresis, the average dissipation of the forward 
and reverse protocols, 



h[K] = i/3(I¥[x|A]}A -f \l3{W[i\k]) 



A • 



(10) 



Because of Eq. (O, the hysteresis is also a divergence 
between the forward and reverse trajectory distribu- 
tions [ii, [H, [53, [H, [ii 



h[K] = i Jeffreys (p[x|A] ; P[i\K 



in which 



Jeffreys(p; g) = Pi log — + log — 
^ gi ^ P-: 



(11) 



(12) 



is the Jeffreys J-divcrgcncc (or symmetrized KuUback- 
Leibler divergence) [30, 31]. In Fig. [21 we plot time asym- 
metry against the hysteresis for single molecule RNA 
pulling experiments at three different rates (see Fig. [1]). 
Both the hysteresis and length of time's arrow increases 
as the pulling rate increases; however, we will show that 
this need not always be the case. For comparison, we also 
display the time asymmetry A[h\ in the linear response 
regime. The work distributions are normal with variance 
twice the average dissipation [9|. 

The relative values of time asymmetry and hystere- 
sis are bounded by several inequalities. Taneja demon- 
strated that A < h/A using convexity arguments [s^ . 
Figure ([2]) shows that this bound is obeyed by the lin- 
ear response calculation and the experimental data. For 
large values of the hysteresis, we can derive a tighter 
bound than Taneja. Since the function f{x) — ln(lH-e~^) 
is convex, Jensen's inequality [13] implies that (ln(l + 
e~=")) >ln(l-he-<^>). Thus, 



JS(p;g) = IX^P'^^ 
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~ 1 + exp ( — 5 Jeffreys(p; g)) 
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exp 



-^(g|b)) 

(13) 



in which last line follows by a second application of 
Jensen's inequality. Hence, A < lnj2/(l + e^'')] which 
we show in Fig. [2| for large h. 

However, there is no lower bound to the time asym- 
metry given the hysteresis. A system can be almost time 
symmetric, but exhibit a large average dissipation. To il- 
lustrate this situation, imagine that occasionally, while 
gently unfolding an RNA hairpin, the RNA becomes 
stuck in a tangled configuration that resists being pulled 
apart by force. While most repetitions of the experiment 



4 



give a work measurement very close to the free energy 
change W ~ AF, for the rare instances of entanglement 
the work is very large W ^ AF. The normalized dis- 
tribution of dissipation V = W — AF for the forward 
process may well be approximated as 

P{V\K) = (1 - p)7V(Po, + pNiVi,al) (14) 

in which N{^,a'^) denotes a normal distribution with 
mean /i and variance . The second term corresponds 
to the rare events, so p ^ 1 and 2?i ^ 1. The work 
fluctuation theorem, Eq. ([6|) implies that the dissipation 
of the reverse process is 

P{V\k) = {\-q)N[Gl-V^,al)^qN{G\-V^,o\) (15) 

in which q — pexp(— 2?x +(7^/2) and normalization re- 
quires that 

(1-p) exp(-Po + aoV2)+pexp(-Pi + (7^/2) = 1 . (16) 

The linear response regime corresponds to p = with 
2?o — o'o/^- For small y and relatively small variance, we 
almost never see rare trajectories on the reverse protocol 
with a negative dissipation —"Dx since q will be exponen- 
tially smaller than p <C 1. The values p = 0.1, T)\ = 150, 
Vo = 0.2 and erg = 1 give h = 7.8 and A = 0.1 (Marked in 
Fig[2|), so a system with small time asymmetry can have 
a large hysteresis. While Eq. ([5]) shows that dissipation 
measures the time symmetry breaking of individual tra- 
jectories [H, [i^ls^, the average dissipation is sensitive 
to unusual events and is not a reliable measure of time 
asymmetry for the entire system. 

One interpretation of relative entropy, and therefore 
Jeffrere divergence, is that it represents an encoding 
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cost [17[ . If we encode messages using an optimal code for 
the message probability distribution qi, but the messages 
actually arrive with probabilities pi, then each message, 
on average, will require an additional D{p\\q) bits to en- 
code compared to the optimal encoding. Analogously, 
the hysteresis represents a cost, the entropy lost to dissi- 
pation. Thus, the time asymmetry A measures the extent 
of time-symmetry breaking and the average dissipation 
measures the price paid. 

The interrelation between time asymmetry and dissi- 
pation may be important for molecular motors and other 
macromolecular biological machinery. One of the cen- 
tral imperatives of any life form is to make tomorrow 
look different from today. On the molecular level, this 
requires rectifying the ever present thermal fluctuations. 
Since the horizontal-axis in Fig. [5] represents dissipation 
in units of k^T, it takes about 4-8 fceT' of free energy per 
cycle to ensure that a machine mostly advances forward 
in time, assuming it stays in the linear regime. This is a 
substantial fraction of the energy budget available from 
the hydrolysis of an ATP molecule, about 20 fceT. 

This research was supported by the U.S. Dept. of 
Energy, under contracts DE-AC02-05CH11231. E.H.F. 
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